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ABSTRACT iy : 

A random half of the instructors of an introductory 
course in coaputer programming were given feedback from students‘ 
evaluations of instructional effectiveness conducted at the niddle of 
the term. The impact of the feedback was assessed against three : 
critecia: (1) change in students evaluations between mid-quarter and 
end-of-quarter; (2) students!’ results on a standardized final 
examination; and (3) ‘affective consequences (application of the  , 

subject matter, and plans to pursue the subject further). The results 
show a positive effect: of student evaluations according to each of 
the three criteria. (Author/SSE) 
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° 


A random half of the instructors of an introductory course in computer 


programming were given feedback from students' evaluations of instructional 


e 


e 
~ 


was anstueed with three different sets of criteria; Change in Students’ 
Evaluations between Mid-Quarter and End-of-Quarten, Student Achievement 
(results on a standardized final examination), and Affective Consequences 


(application of subject AEE and plane to pursue the subject further). 


results provide strong support for the favorable impact of feedback from 


students’ evaluations on each of the three sets of criteria. 
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THE RELATIONSHIP BETWEEN STUDENTS’ EVALUATIONS OF 
FACULTY AND INSTRUCTIONAL IMPROVEMENT 


. Jesse U. Overall 
- California State College‘ 
se Herbert W. Marsh “@ 
University of Southern California 
Students' evaluations of instructional effectiveness have become 
increasingly prevalent at institutions of higher education. Students 
seek access to such evaluations for guidance in selecting courses and 


instructors; faculty, concerned with effective teaching, are interested 


' in how their instruction is perceived by students; and, administrators, 


faced with steady-state or shrinking resources, seek -effective ahd . 3 
efficient means for making personnel decisions. | 

The comparative ease with which objective student evaluations © 
of instruction may be collected, analyzed and reported is a fundamental 


reason for this popularity.’ One cormon and representative means of - * 


obtaining these evaluations is based on student completion of assess- 
‘ment questionnaires during 15 to 20 minutes of class time; the response 


. sheets are then optically scanned at the rate of 500 per minute, and 


the raw data are collected on magnetic tape; finally, a computer reads 


the ape, summarizes the responses, and "orders' its printer to provide 


an easy-to-read, standardized summary of results for all those evaluated. 


’ 


Summaries are then quickly available for students, faculty and séntnieteacive 


teview. Existing technology thus jahies posainie the efficient production 


. of such information at even the largest. of uniyfedties, | ‘ 
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receive feedback from their students? Do students of instructors who 
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‘TF institutions do not possess the necessary equipment, then the 


~ 


Center for Faculty Evaluation and Development (CFED) provides its 

iiaknieeionad Development and Assessment (IDEA) system, or Ediicational 

Testing, Service (ETS) makes available the Student Instructional 

Report (SIR) for evaluation purposes. Schools that use the IDEA system 

or the SIR may request scoring, interpreting and summarizing services 

from ETS and CFED for a nominal charge. , : - 
While aSenmugedning the progress that has been nile in efficiently 

accommodating the large amounts of individual data that must be ‘collected 

and processed, members of the academic community have ‘sehdived whether-- — 

in our fascination with developing the tachnélogy fon the process--we 

have become distracted from the real issues surrounding she product. . 

eae so certain that, even if students! assessments of seeeneuds 


“” 3 - 


effectiveness are collected, there are any proven benefits that accrue 


- 


from the subsequent dissemination’ef this information. “The objective of 
eo J . 


this study as te phovide insight into this question. , 4 
* REVIEW OF THE LITERATURE 
: The. isale oe the usefulness of students’. evaluations is cit that has 
been raised ‘anereasingly in the a few years.’ In essence, it is concerned 
with the benefits that accrue from collecting students! evaluations oF = 
instructional ge ruibaneeai: Many possible benefits can be imagined; yet, 
certainly the central | benefit. = that of in tructional Naren Can it 


be demonstrated that there is some value to informing. in trucfors of 


- 


‘students’ perceptions through periodic feedback? More ‘specifically, do 


‘-dnstructors who receive mid-term feedback subsequently receive higher ratings 


from their students at the end of the quarter than instructcrs who do not 


Re ¢ a r § 
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compar © those who received no feedback. 


. 
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receive mid-quarter feedback learn more or develop a more positive attitude 


- 


toward the subjedt matter than students of instructors who do not receive 
mid-quarter feedback? tg 


"Gage(1963) aed students! post feedback aus of their sixth 
grade teachers, adjusted for differences in initial student ability. 
Mean patiage Hon Ate feedback group instructors were higher than those ° 
for the no-feedback group instructors on 10 of 12 items; on one item, ; 
there was no difference and on‘ the other item the no-feedback’ group 
averaged slightly higher. Four hit ferenceanyeen nieelanienlty signif e: 


icant (p<.05) and favored the feedback group: These four items involved * 


. ‘ 5 : ry ¥2 
pupil-teacher interaction and the ability of the teacher to explain theory =, 


through everyday exam es. - | 


é “Tuckman and otiver(1968) asked students of 286 vocational tichacs at. 


a Rigiecheos or technical institute level to rate their teachers Siriaas 


during a 12 week antervals Teachers assi<. “3d to, the feedback group were 


the no-feedback group MENS. not. 


given furmaries | of their students’ initial absessments; those athioasas to. 
s 
tne of the study showed that the » 4% 


presence of students’ Feedback produced statistically significant positive ; 


changes in ratings given to instructors selected to receive feedback,*as ’ ’ 
Miller(1971) sought to determine’ empirically whether providing ‘ 
graduate, teaching assistants (TAs) mid-semester feedback from students’ - 


_ Z t ‘i : a 
ratings had any effect on subsequent ratings or on stidents' Gee O 


‘ 


Students! achievement was measured by objective tests constructed from a, 


e 


itens submitted an” discussed by the TAs. Results showed that average 
A 


end-of-term ssthnas for TAs receiving mid-term neudhack were not, ‘significantly 


“‘aifferent from ‘average ratings of those who did not cache feedback. 
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wean ‘examination SeOres however, weve higher. for students ines instructors 


received feedback during thé. term than for those whose anatnuetors did’ not. — 


’ Centra(1972) assigned faculty seabers from Five different types of 


: pottegen toa feedback, no-feedback or: post-test only experimental condition. 
' 


Only the féedback group instsuctors es results of mid-term and end- - 


' of-term evaluations ‘from their students. Average end-of-term ratings for 


_* both feedback and no feedback groups were almost identical ‘on each iteu, ” 
‘suggesting that instructors who received feedback were ‘unable to benefit maT ae 
"from it between the mid-term and end-of-term periods. a 

“ 


- To further explore this phenomenon, instructors in the initial 


a 


feedback group received mid-term feedback during an ‘additional term. 
Their second semester end-of-term ratings ware then compared to those 7 
cf a randomly chosen ‘group using the rating form for the firSt time. 


This time, those who received feedback did average higher ratings ‘than 
A 


thoge who did not. The results suggest that perhaps a longer cetioa of 


time is necessary for the impact. of feedback to be felt. 


x 


Pao 
‘Marsh, Fleiner and Thomas(1975) examined ee Por of* teaching. 


- 


at 


assistants (TAs) furnished by undergraduate students in 18 different 
sections of an intPoductory course in ro progranning. ane Tas pr oa 


were eyaavared by ‘their. students during mid-term and at the end of the 


assigned to the feedback condition received the results of ‘their mid- 


° 


; quarter, on a 46-item evaluation instrument. Those TAs randomly . - 


quarter evaluations while the bike TAs ata not. No differences, in 


vs 


a a on a common objective’ final exanination were found ‘between me 
ee ee OY 


students of instructors wai vacetond feedback and students of instructoré~ 


a 


‘iho did not . Positive differences in mean ratings on six of ‘seven “. 


evaluation. factors and shea of Hue 3 amary judgment items were obtained 


, 6 5 : 
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“ at present compare to the quality of instruction at the ‘beginning of the — 


; “favoring the ‘feedback Sroug ever n pherto ‘feedback group. Two of the factor 


score differences = statistically significant (p< ts): Instructor 
Approachability si Read ings factors. Statistical significance , (p<.01) 


was obtained den the sumary item: “How does the quality of instruction. 


om eP- 


quarter?" , ; aie 
, Td summarize the existing studies = the: usefulness of danthade, 
Ait can be ‘said that while the utility of mid-term edback was demonstrated 4 
in the two non-college studies, a lack of spose existed at the college 
: level. Miiter(1971), using a cross-sectional design, found no statistically . 
asppisicant dierevences between average ratings for feedback and no feedback 
group dyntntiekens, Hopetty: students ‘of: instructors who received feedback 


did perform better ‘on a common final examination, than did students of 


instructors who did not receive feedback. cehera(1972) algo found no . 


statistically significant differences over a one term period, but did F p l = 


/ 
discover significant ‘aigeas over two terms? : Marsh gna tssoctates( 1975), 


using a cross-secti¢nal design, foutid statistically significant, positive eee 


* autterences on a nunber of items = oe Feedback and no feedback group tw 


° 


instructors. ; ae ma es 
F >) 4 ) te < ; i 3 
‘« METHODOLOGY ae” “Bert 
 Subjetts > int ( a % ae 
: he - , . ' 


Subjects were the 993 University. of ‘California, Los Angeles. undergraduates | 


* ‘iho conpleted BRET RGSHINE 10 (E 10), an introduetory. course in computer 

pr nning, during the fall, winter or spring quarter of academic year 1973-74, 
‘Theda ee ts were tpdeaty soci or behavioral science majors, and were 
‘taking wees to fulfila a aeparinetcal requirement. A different course | ‘ ‘a 


was offered for erate majoring in eagineering © the physical sciences. a 


e 6- 
— enrolled in one of the sections of E 10 before ‘the 
" start of each ae aeee quarter. Selection of sections was, made solely 
on tne basis of the time at which the section met; students, had no prior 
irfeormation about who would teach the different sections. The course 
format, including the textbook, assignments , content, construction of ‘ 
commn final examination, and grading er the examination, was under the 

* supervision of the course director. The, course itself, was taught re 
by graduate pesehing aSes Stents (TAs). Each’ TA taught only a single 

r section, iti any ere auartan,. but taught at least two of the three 


quarters during which the study was conducted. 


Materials ss . 4 4 ag RS 4 
A pretest , developed to predict final exanination performace, : 
. _ consisted of background aha demographic items (grade point average, 

; Scholastic pptitude Test score, space ed in mathematics, for example) 
and a short papep-and-peneil achievement test. .Results of the pre est , 
correlated 0.56 with the final exam. poe iteinaty analysis indicated that ’ 
‘predicted final examination scores for the 30 sections involved ta not 
differ to a tentepieatiy significant ‘stent, This ‘finding reinforced the 

assumption that the average ability levels ‘in each section did not differ. ; 

\ The student aie instrument, developed for this mous by the 

Evaluation of taatpdcttion Program (EIP), was Aestgped to measure seven 

dimensions of teaching. - Factor analysis of the end-of quarter (£09) 


; evaluations--a principal components solution followed by ‘an oblique rotation 


(Nie and Associates , 1976 )--showed that oy seven factors was defined 


e 


' 


by the items designed to measure it. Facote“an lysis of the mid-quarter. (MQ) 
s 
evaluations gave: saci tally the yee solution, Factor scores for | 
_ oA é a . 


; 
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each evaluation dimension were computed by taking an unweighted average of 
atendardived responses: to teens that defined each. factor. Factor scores 
for the MQ evaluations were computéd in exactly the same manner. The 
evaluation instrument also included five items designed to provide infor- 


‘ 


mation about the affective consequences | of E 10 for each student. These 


: consequences! focused on the degree to which the student felt that he or she 


: tit apply the subject matter by the end of the course, and the extent to 


which the student planned to pursue the subject matter further after the 

course had been completed (Overall, 1977). ai noes 
A common. final CARTAN was taken by all students during the 11th 

week of the course. The exam was basically of the objective type, with 


several practical programming exercisés included. Each programming exercise 


was graded by only one instructor to insure “consistency. The specific Bess 


content of the exam, developed by the coursé directory Has not made avail- 


. able to the TAs before the examination was administered to the students. 


Procedure . 

Student enrolled in one section of the course before the start of 
each 10-week erm. Selection of sections ap made solely on the basis of 
the time at which the section met, as students had no information about 


who would cnadh the different sections. Three different instruments were 


administered during’ each term. The pretest was administered to all students 


during the first week, the ‘mid-quarter evaluation was administered at the 


_ end of the fourth nek; and the end-of-quarter evaluation was Admindetened 


\ 


_ at the end of the tenth week. All three instruments were sdntatatered by 


7) . a 
““ ‘an employee of EIP who had no connection with the actual course. Although 


students were required to put their registration number on each instrument, 


they were assured that their responses would remain anonymous, 


* 
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Instructors were randonly assigned to the feedback (FBK) or no 
feedback (NFBK) conditions at the start of the first quarter. Results 
of the students' evaluations.of instructors in the FBK condition 
were available by the start of the sixth week of classes; normative 
data indicating how the instructor's individual evaluation compared with 


3 the evaluations of instructors in the other sections were also available. 
oe. . \ 


FBK instructors were also given the results of the E0Q evaluations at the 


end of the term. FBK instructors continued to receive feedback for all 

_ three irms of the academic year. Results of the evaluations af weutente 
in the NFBK condition were not given to their instructors until after the 
end of the academic year during which the study was ssnduated, In some 
cases, “instructors did not teach all three quarters, but this eecureed 


equal ly often in the FBK and NFBK conditions. In these cases, any new 


instructors were randomly assigned to the two conditions. Every TARSEUE TON 


: both those in the FBK and o the NFBK conditions, taught two of the three 
y ‘ 


quarters. 


' Statistical Analysis 


‘ 


he - The impact of feedback from students’ evaluations was assessed by 
comparing the responses of stulenté who had an inwtbetas either in the 
FBK’or NFBK condition. Three different sets of comparisons were made: 
1) changes between MQ and E0Q evaluations for the FBK and NFBK group 
instructors, 2) achievement on a common final exam by students of the 
FBK and NFBK group instructors, and 3) extent of affective consequences 

' * for students of both FBK and NFBK instructors. Analysis was complicated 


. \ ae < 
~ by the fact that a different number of responses was available for each 


— +) 


8 of the three sets of criteria. . 


10 
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Changes in students’ evaluations were assessed using analysis of 


aes covariance. Analysis of covariance is very similar to comparing change — 


- socres for the two conditions using a t-test, but provides a stronger ‘ 
statistical test of group differences eee of: its ability to control , 
for pre-existing sources of potential bias (Anderson and Associates, 1975). . 
The E0Q evaluations . controlled for the effect of any differences in ratings 

J. 


of effectiveness existing up to the MQ evaluations, ‘were compared for the : 

PBK and NFBK conditions. This analysis could only be performed on a id 

of|students who had: ciate both the MQ and .E0Q evaluation questionnaires 

(nls 674). 7 ioe. * BS ‘ 
Final examination scores were available for all students who completed 

the ourse (n = 993). ‘The statistical significance of average achievement 


. 


differences between students f FBK and NFBK instructors was apaerses by | 

pein a t-test.on the final exam score differences. = 

a ective consequences, : erceptions of which were collected as part of x 
the. E0Q levalaattenn were available for all students who evaluated inxtactoes 
during the last week of the course (n = 796). The impact of feedback was 
again determined by doing a i -test on differences in students' perceptions 


with respect to instructors’ to the FBK and NFBK conditions. 
; | : 


RESULTS 


~ 


Change in Students’ Evaluations 
; If MQ sea ations given to instructors in the FBK condition were useful, 


then evaluations\ by their splonky at the end of the term should be improved 
my to a statisticall significant extent, compared to improvements. in evaluations 
‘of the NFBK instru tora | The £0Q evaluations, with the effect of MQ eval- | : 
uations (covariate ‘yonoved through analysis of covariance, were generally | 


more favorable for the group of instructors who received MQ feedback (see 


st is ie ick . fal a lt « - Se | 
He . $ < ‘ : Rig ? 
. . . * 
‘ ry , 
tad o x _ -10- in ‘ < 4 
* : cy ‘ 
: fe ‘ 


'} ‘ ‘ 
Table One). Differences between the two conditions reached statistical a. “gh oak 


significance for the two summary rating: itens, the perceived difference 
in instructional quality item, and four of the seven evaluation dimensions » 
A Instructor Concern, Learning, Instoucter-Student. setgeectien and Piasheationt 


These results\support the position that feedback from students evaluations . 


of instructional effectiveness is useful. Pitta oe ts 
on Insert Table One About Here----- ; | 
. Existing neemareh about the relationship of feedback to dee tuxtiaae jo at 


improvement has not been consistent. Single term tudies by iitler(1972) | , 
\. > and Centra(1972) did not report any ia significant differences ai 


between average ratings of supeanatone ake receiv q. MQ feedback and ‘average, | 


ratings of instructors who did not. Marsh, “Fleiner and Twomas(1975), how 
. found statistically’ significant differences on two rating dimensions ( Ins 
5 ‘Approachability and Readings) and for an identical perceived difference in: 
instructional quality item (t(285) = 3. 85, Pp .001) favoring instructors wh 
. received nid-quarter feedback over a one quarter periods Thus, results of] | 
this study appear to be more supportive of the study by Marsh and seiooiat s e 


than of the pinta! by Miller \ Centra. / 


e . > ; . , F ; ‘ 
Achievement my 2a : rt 
- The second criterion used to assess the usefulness of feedback was L. oe 


student achievement on a common final examination. Students of foateuxe 


7 haat received féedback performed better, to a statistically significant ne 

| ; 
on this test of course mastery, | chan” students of Anetpuctors wha did not. cS ‘ 
_ weceive feedback. .This differential in average performance provides a sieeve: 


argument. for the postéton that students! evaluations are related to improved 


120 : 4 


_: Affective Consequences, ~ 3 go ee % 


: usefulness oF mid-quarter ig ares _from students! feedback. 


feedback. ‘ 


: 
ee oe : . | : 
student learning. ~ a SE 7 
F -----Insert Table Two About Here----- : . me | 

‘ — “$wo other studies have dealt with the relationship of aeedzach to * “te 


\ 


‘ students * performance on a common final examination. Mamta and ; 
Mersh, Fleiner and Thomas(1975) both found no statistically significant 


' differences between the performance of students whose instructors did or 


cy 


aid not. receive Feedbacks . Because of the contrast in findings with 


previous research, and pecaues ‘the mesults of. this study reached an acceptable te? 


but not definitive level of significance, additional research is recommended . 
s . 


t. 


b 


‘student? of instructors in the FBK haa the AvENAEA “ete nore. : 4 


an 


favorable responses to. each of five ‘affective consequence itens (see Table / 
ral 


Three), the differences re pene! statistical significance on three items, i 


4 


These differences in the affective consequences of E 10 also supported the ; / 


= is 


‘ * ‘ * 5 A 
Ap ~--~-Insert, Table Three About Here----- rm ‘ / ; 
ee or : 
’ iO soe CONCLUSION 


x : ad 


This study has presented evidence supporting the utility of students | 
evaluations of ingtructional effectiveness ¢ First, students whose instructors 
received MQ feedback rated shear instructors higher, as a group, by the end 
of the of the ‘quarter than did ‘etadents whose instructors did not receive 


Seas 


ce results provide | a reasonable basis to assume that’ instructors 


found the feedback nechanisn a useful source of information on whieh: to base 


both: ‘their’ ovn assesonents! of instructional effectiveness by nid-quanter, 


sear . ~ 
. a, 
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"ab plane for changes in their conduct of the class responsive to students’ 
‘needs. | This iggente: the potent role that feedback may play in the learn- 


ing environment. 
a. Second, the positive relationship between receiving MQ feedback from 
i: 

d students’ achievement on a .ommon final exam 


‘students" evaluations 


suggests that seoattly 


_ to cognitive growth; 


m auch ratings results in‘a cLindte more conducive 
eudents' learning is very much the concern sd colleges. 


af - 


and universities, and feedback from students! evaluations may help tawuKe* a 


a 


classroom environment supportive of Leadning. t% 


Third, two important indicators of a successful learning experience are 


r 


the ‘extent a student desires to pursue the subject matter further or apply 
what he or she has learned after the course has ended, In this study, students 
of ee in the FBK condition showed ,a much stronger desire to pursue a 
further coursework in ane area of computer programming by the-end of the SOUnNSs: e 
and were more, positive co joining the campus computer club to apply wee | 
he had learned, than were students of the NFBK instructors. Thus, this 
‘positive sisi a between receiving. feedback and more positive affective ‘ 
consequences aOR students is of great significance. 

Based an the positive findings outlined above, it is clear. that the - 
allocation of resources ‘to support perfodic ‘dssessment can be justified. " 
From the standpoint of instructional improvement alone, this research indicates | 
that these evaluations have the potential to influence effectiveness in terms ; 
of students! cognitive and affective development. Furthermore, if the pee 
eReuiee shown in this study c be obtained through limited summary and com- 
parative MQ feedback information, there is potential for even greater improve- 


ments through more aishdpate and sopniaticaesd means. flepanenents may have 


v 
instructors who-are strong in their research and community activities for the 


- Q 


140 


. { . 


s 
1 


university, but who are not perceived by students as effective instructors. 
These instructors, working through an instructiohal improvement unit on f 
campus, might very well oltain assistance essential to this improvement ‘|, 


through the administration of previously validated and tested evaluation 
, : j 


instruments midway through their course. 
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TABLE ONE 


‘B-Values for PBK or NFBK Instructors' 
Differences in E0Q Students’ Ratings 


= < DIMENS TON F-Value! i 
» Concern - F(1,669) = 20.93¢e* 
1° Organization —F(1,659) = 1.62 
Learning (1,668) = 9,29%¢ 
Interaction _F(1,661) = 8.9098 
Breadth F(1,654) = 1.79 
"Difficulty F(1,674) = 0.99 
Examinations F(1,657) = 8.469 : 
Overall Rating : | 
of Instructor = F(1,673) = 16.42ee¢ 
: Overall Rating 
of Course F(1,671) = 3.68% 


Perceived diff. 
in Qualit 


F(1,658) = .9.62¢8 

*p<.05 . 
**p<.01 
#**n<.001 


‘lp-values dre the result of an 

: analysis of covariance testing 
for differences between the two 
conditions with the effect of 
MQ evaluations controlled. 


. 
y 


\ 


TABLE TWO 


/ 
/ ~ 


' Differences in Pinal Seear 4 Scores of Students with | 
Instructors in the Feedback oF No Feedback Conditions 


¥ tion vondition t 
Final Examination. (n = 386) (n = 408) 
Mean ‘ §1.2 pat 49.74 
Standard | 3 2.35% 
Deviation 9.86 9.84 ; 


*p¢.05 


Instructors in the Feedback or No Feedback Conditions 


ean t 
(a = 386) (n =~ 408) 


(Extent that... 
++ you feel capable of writing and running a 


computer program to solve f ture problems. 5.43 
mt 


5.76 9.088. 
+ you have gained enough understanding of: y i : \° 
what a computer is ‘capable of to be useful 

6.13 5.95 


to you in the future. 


++ you plan to become (or remain) a member 
of the campus computer club or find other. 
sources of computer time in the future. 


yy .you plan to make practical application 
‘of the computer in the mers 


o 


; APPENDIX I 
FACTOR AMALYSIS OF THE EVALUATION ITEMS 


* ‘ 

Factor analysis of the End-of-Quarter evaluation items, a principle components edie 
rotation to a direct oblimin criteria’, resulted in the following factor pattern matrix (loadings of less than .20 are 
indicated.with dashes). The loading of each item on the factor it was designed to measure appears in @ bold box. F 
The.evaluation factors are moderately intercorrelated, 

The factors are generally positively related to each 


Every item loads higher on its own factor than any other. 


correlations ranging from .03 to .50 with a median of .25. 
’ other with the exception of the workload/Difficulty factor which has low negative to zero correlations with the other 


fectors. 


. Evaluation Items 


I LEARNING s 


Intellectual curfosity in subject stimulated 

-Learned something valuable . 

Present interest in course subject ‘ 

Developed understanding of practical implications® 
* Degree of course mastery j 


* e ' 

x F - 

11 CONCERN, ’ a 
e. 


astructors presentations made subject understandable 
. Instructor concerned with student earning/understanding 


Instructor enthusiastic about teaching . 
Instructor made course relevant a 


4 . ‘ % 
TTT: ORGANIZATION 
* Course material outlined and carefully explained 


pursued « * ; f 
Wature/purpose of assignments clear 
-| Presentation well prepared and integrated 
_ Workload evenly spread over term 


. i 


IV STUDENT-TEACHING INTERACTION =~ Te 


"7 Students welcored to seek help/advice 


— Students encouraged to ask questions and were given answers 


Students free to disagree and/or express own ideas 


¥ BREADTH OF COVERAGE t & 
Instructor contrasted implications of theories 


wo 


= Course esactians stated and agreed with those actually 


¥ Instructor presented background/origin of ideas/concepts 


Instructor discussed different points of view 


VI EXAMINATIONS/GRADING ‘ ‘ 
~ Graded materials adequately measured your knowledge 


~ Graded materials measured content as emphasized in course 


# Grading was fair and objective r 


_ VET" WORKLOAD/DIFFICULTY 
Workload/pace was difficult 


Course difficulty : 
r Hours/week outside of class 


OVERALL INSTRUCTOR RATING 


OVERALL COURSE RATING 


1 “ 


- 20 
5 
= 40 
- * 


8 


est 6 
’ 


\ 


. 


' ra 
Jetgenvalues of the first seven principle components were 11.9, 3.0, 1.4, 1.3, 1.1, 1.2, 0.9. 


aenee 


v3 


e 


1 followed by an ob) ique 


VII 


eeee 


2ractor analysis was preformed with the Statistical: Package for Social‘Scientists (Nie, et. a., 1976), 


. 


18 


. 
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